Survival probabilities in time-dependent random walks 
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We analyze the dynamics of random walks in which the jumping probabilities are periodic time- 
dependent functions. In particular, we determine the survival probability of biased walkers who are 
drifted towards an absorbing boundary. The typical life-time of the walkers is found to decrease with 
an increment of the oscillation amplitude of the jumping probabilities. We discuss the applicability 
of the results in the context of complex adaptive systems. 
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Random walk is one of the most ubiquitous concepts 
of statistical physics. In fact, it finds applications in 
virtually every area of physics (see e.g., [1-6] and ref- 
erences therein). Random walks in the presence of ab- 
sorbing traps are much studied in recent years as models 
for absorbing-state phase transitions [7,8], polymer ad- 
sorption [9], granular segregation [10], and the spreading 
of an epidemic [11]. 

One of the main characteristics of a random walk in 
the presence of an absorbing boundary is the survival 
probability S{to) of the the walkers, the probability that 
a walker has not reached the absorption point before 
tg. When the walkers are drifted towards the absorb- 
ing point, the survival probability falls exponentially at 
asymptotically late-times S{t) oc exp{-~t/Ts), where the 
characteristic life-time Tg depends on the drift velocity 
(see e.g. [12]). 

The problem of random walks with an absorption 
boundary has recently been extended to include situ- 
ation in which the jumping probabilities of the walk- 
ers are time- dependent [13]. The solution presented in 
[13] accounts for the binary (alternating) case, namely 
p{t) = \ — ep-\- (— 1)*A, where p{t) is the probability to 
step to the right at time t. Here A is the oscillations 
amplitude, and > represents a net drift towards the 
absorbing boundary (the period of such binary oscilla- 
tions is T = 2). It was found [13] that the characteristic 
life-time of the walkers depends on the amplitude A, in 
a non-trivial way. In particular, was shown to decrease 
monotonically with the increment of A. While this anal- 
ysis provides a useful insight into the behavior of such 
time-dependent random walks, it is of one's interest to 
explore the general case time-dependent jumping proba- 
bilities with r 7^ 2. This is the main goal of the present 
work. 

In addition to the intrinsic interest in such time- 
dependent random walks, our work may find direct ap- 
plications in many complex physical, biological, and eco- 
nomical systems. In fact, the main motivation for the 
introduction of time-dependent random walks in [13] was 
its applicability in the flourishing field of complex adap- 
tive systems. In the well-studied model of the minor- 
ity game (MG) [14], and its evolutionary version (EMG) 
[15] (see also [16-28]), it was found that the winning 



probabilities of the agents display a periodic behavior 
in time. This implies that the survival probabilities of 
the agents are well-described by a model of a periodic 
time-dependent random walk with an absorbing bound- 
ary [13]. The analytical model presented in [13] (with 
T = 2) provides an elegant explanation for the intriguing 
phase-transition observed in the EMG [25] (from self- 
segregation to clustering as the prize-to-fine ratio drops 
below some critical value). However, numerical studies 
of the EMG [27] have indicated that the period of the 
oscillations (in the winning probabilities of the agents) 
depends on the specific parameters of the system. Ex- 
tending the analysis of [13] to the general case of time- 
dependent jumping probabilities with T 7^ 2 is therefore 
highly motivated. 

We consider a time dependent random walker who is 
drifted towards an absorption boundary, located at —d 
(where rf > 0). The drift towards the absorption point 
may be attributed to two distinct reasons: (i) A smaller 
(average) probability to take a step to the right (away 
from the absorption point). That is, {p{t)) — 1/2 — 
where Cp > 0, and (ii) a smaller step size r to the right, 
< r < 1 (where the step size to the left is scaled to 
1). This kind of drift is characterized by the parameter 
Cr = 1/(1 + r) — ^. In the unbiased case (cp = = 0) 
there is no net drift, and the survival probability is well 
known to scale as an inverse power-law: S{t) oc t^^/"^ . In 
the presence of a drift (cp > and/or Cr > 0), and with 
a constant {time- independent) jumping probabilities, one 
finds (see e.g. [12]) 



S{t) oit'h^'/^^ 



(1) 



This result holds true in the binary time-dependent 
model [13] as well, in which case the jumping probability 
is given by the alternating function p(i) = i— ep-|-(— 1)*A. 

Below we explore the time-dependence of the survival 
probability S{t) for a general periodic p{t). Let 



P(t) + Fit) , 



(2) 



where F{t) is a periodic function, with a period T. The 
mean of F (over one period) is given by 



1 



{F)^{l/T)J2m^-e 
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(3) 



In the time-independent case it has been established 
that the probabihty B{t) for a random walker (with no 
absorbing boundary) to be located on the right hand side 
[x{t) > 0] at the time t is given by B{t) oc exp[—t/TB], 
with tb = Ts (see e.g., [12]). Motivated by the equal- 
ity tb = Ts in the time independent case, we will find 
the asymptotic form of tb in the general case of time- 
dependent jumping probabilities. We will establish the 
relation tb{T = 2) « Ts(T = 2) analytically, and demon- 
strate numerically that tb(T ^ 2) w r,(r 7^ 2). 

We first consider the case in which the period T of 
the oscillations is a natural number. Let ui{t) be the 
number of right steps taken by the walker out of t steps. 
The walker is located at the right hand side [x{t) > 0] if 
CO > u)c, where 



t-d \ 

<^c = — t( - + er) 

1 + r ^2 ' 



(4) 



in the t d, T limit. 

Note that w is a sum of T independent binomial dis- 
tributions with a success probability Pi = p{t — i). After 
time i 3> T a step is chosen ~ t/T times from each one 
of these distributions. Thus, for t ^ T, oj is distributed 
normally with an average of iJ,w{t) = t(| — Cp), and a 
variance al = ^ J2j=i Pii'^-Pi) = t{l - A{F'^))/A, where 



{F^)^{l/T)Y,F^ii) 



(5) 
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Hence, B(t) can be approximated by this normal distri- 
bution, with the condition w(t) > uodt) 
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where 



2cjH 



Tb 



{wc - m)^ 2(ep + Cr)^ 



(6) 



(7) 



and erfc is the complementary error function. The 
complementary error function can be approximated as 
erfc{^Jt/TB) — e"*/"^^ / i/Trt/T^ at asymptotically large 
times. One therefore finds 



B{t) oc e-*/^« . 



(8) 



The model of binary time-dependent jumping proba- 
bilities [Fit) = —€p + A{—\y] was solved exactly in [13], 
the expression for Tg is given by Eq. (16) of [13]. Ex- 
panding this expression for small Cp and Cr, one finds 



Ts{T = 2) 



1 -4v42 
2(ep + e,)2 



(9) 



This agrees with Eq. (7) in the limit ep <§; 1 (or equiva- 
lently, > 1). One therefore finds Ts{T = 2) ^tb{T = 
2) in the ^ 1 limit. 

The generalization of the above analysis for an arbi- 
trary period T is straightforward. If T = m/n is a ra- 
tional number, then F(t) could be replaced by an equiv- 
alent function with a period m which is a natural num- 
ber. If T is an irrational, then the all range of values 
of F(0 < t < T) is sampled (over many periods of the 
oscillations). In this case, one should replace Eqs. (3) 
and (5) by 



and 



{F) = ^J%{t)dt = -e 
{F^) = ^j%\t)dt. 



(10) 



(11) 



In order to confirm the analytical predictions (in the 
T ^ 2 case), we perform numerical simiilations of (dis- 
crete) random walks. We first consider the case of an 
harmonic function p(t) of the form 



P{t) = \-^p-Acos{^) ; T>1 



In this case {F) 



and 



T 



{A/V2f 



= 2 
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(12) 



(13) 



This implies that for T 7^ 2, rs is independent of the 
period T of the oscillations. Moreover, we find that 
tb(T ^ 2, Al\f2) = tb{T = 2, A). As we know that our 
approximation holds true for T = 2 (The exact shape 
of F is irrelevant in this case), one should compare the 
survival probabilities in the T = 2 and T 7^ 2 cases. Fig- 
ure 1 depicts t{S — 10^'^), the step number in which the 
survival probability has fallen to S* = 10^^, as a function 
of the oscillation period T (and for three different val- 
ues of the oscillation amplitude A) . As predicted by Eq. 
(13), the survival probabilities are almost independent of 
the period T, except in the unique case of binary oscilla- 
tions with T = 2. Moreover, S{t;T = 2) < S{t;T ^ 2), 
in agreement with Eqs. (7) and (13)]. In addition, the 
numerical simulations indicate that the survival proba- 
bility decreases monotonically with an increment in the 
oscillation amplitude A, in agreement with the analytical 
prediction Eq. (7). 

In Figure 2 we confirm the relation S{t, Tj^2,A) = 
S{t,T = 2,\/2A) in the harmonic case. The figure dis- 
plays the step number t{S = 10~^) for which the sur- 
vival probabilities have fallen to 10~^. It is clear that 
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FIG. 1. The step number for which the survival probability 
has fallen to 5 = 10^''', as a function of the oscillation period 
T, and for three different values of A. The jumping proba- 
bilities p{t) are characterize by harmonic oscillations, and are 
given by Eq. (12). We use A'' = 10* walkers, = 0.1, r = 1, 
and d = 2. S{t) is independent of the oscillation period T, 
except in the unique case of binary oscillations with T = 2 [in 
which case S{t) is smaller, in agreement with the analytical 
prediction.] In addition, S{t) decreases monotonically with 
the increment of the oscillations amplitude A. 



t{S = 10~^) for T = 2 agrees with the corresponding 
value in the T ^ 2 case, provided one uses the transfor- 
mation A — > ^/2A. 

We further check the validity of the analytical results 
for F{t) in the form of a square wave of amplitude A, and 
a mean value —€p. In this case one finds {F"^) — 6^ + 
for any T. This implies that tb{T) should be indepen- 
dent of the period T of the oscilations (and in particular, 
Ts{T) — Ts{T — 2), where Ts{T — 2) was derived ana- 
lytically in [13]). Figure 3 depicts t{S = 10"^), the step 
number for which the survival probability has fallen to 
S — 10^^, as a function of the period T. We display re- 
sults for three different values of the oscillation amplitude 
A. The numerical results confirm the finding according 
to which S{t;T) is independent of the value of T. Fur- 
thermore, the survival probability S{t; T) decreases with 
increasing amplitude A, in agrrement with Eq. (7). 

In summary, in this paper we studied the survival prob- 
abilities of biased (drifted) random walkers, whose jump- 
ing probabilities are time- dependent. This is an exten- 
sion of the binary case (with T = 2), studied in [13]. 
The long-time asymptotic survival probability is domi- 
nated by an exponential fall S{t) cx exp[—t/Ts]. We have 
found a simple approximation for Ts [see Eq. (7)], which 
solely depends on the first and the second moments of 
the oscillations ((F) and (F^)), and on the step-size drift 
parameter e^. 

Our analytical results imply that the characteristic life- 
time of the walkers Tg decreases with increasing (F^). 
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FIG. 2. The step number in which S — 10~^ as a function 
of the oscillations amplitude A, and for two different values 
of the period T. The results confirm the analytical prediction 
according to which S{t,T = 2, A) = S{t,T 2, V2A), where 
p{t) is an harmonic function. The parameters used are the 
same as in Fig. 1. 



The larger are the temporal-oscillations in the jumping 
probabilities p{t), the smaller is the survival probability. 
This result generalizes the one derived in [13] for the 
binary case (with T = 2), in which case (F^) = A^ -\- e^. 

The qualitative nature of the anti-correlation between 
the survival probability S{t) and the oscillation ampli- 
tude (F^) is rather simple. It is a direct consequence of 
the positive correlation between (t) (the dispersion in 
the access of right-steps taken out of t steps) and S{t) 
in the presence of a negative drift (towards the absorp- 
tion boundary). In the presence of a net drift, /i^j (the 
average value of w) is smaller than lOc- A large (T^{t) is 
therefore required in order to survive, that is in order to 
have Lo > LOc at asymptotically late-times [29] . 

Finally, the present analysis provides a direct expla- 
nation for the underlying mechanism responsible for the 
intriguing phase-transition observed in the evolutionary 
minority game [25,15]. In this model, the winning prob- 
abilities of the agents p{t) where shown to display tem- 
poral oscillations [27]. The amplitude and period of 
these oscillations depend on the various parameters of 
the model (such as the price-to-fine ratio). In [13] a toy- 
model of time-dependent jumping probabilities with a 
period of T = 2 was used to reveal the physical source for 
the phase-transition. In the present work we have shown 
that the anti-correlation between the characteristic life- 
time Ts and the oscillations amplitude (F^) is a generic 
feature, independent of the period T of the oscillations. 
Thus, our analysis (for generic values of T) lends support 
for the general applicability of the conclusions presented 
in [13]. 
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FIG. 3. The step number for which the survival probability 
has fallen to 5 = 10^", as a function of the oscillation period 
T, and for three different values of A. F{t) is a square wave 
with amplitude A, and a mean value — tp. We use = 10^ 
walkers, tp — 0.1, R = 0.9, and d — 2. We find that in 
this case, S{t) is independent of the oscillation period T, in 
agreement with the analytical results. 
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